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Listing of Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 

1. (Previously Presented) A remote operation system for remotely 
operating a device to be operated through a communication network from an operation side 
terminal, comprising: 

screen analysis means, provided on said device to be operated, for analyzing 
information displayed on a screen of said device to be operated, and 

screen information transmission means, provided on said device to be operated, for 
transmitting data of an analysis result obtained by said screen analysis means to said 
operation side terminal to display the data on said operation side terminal, 

wherein said screen analysis means determines whether or not an active window is 
present on the screen of said device to be operated, and if so, said screen analysis means 
obtains property information of objects displayed on said active window, and 

wherein said screen information transmission means transmits only the data of the 
active window and the objects displayed therein, to said operation side terminal, and does not 
transmit any information on the screen of said device to be operated that does not correspond 
to the active window. 

2. (Original) The remote operation system as set forth in claim 1, further 
comprising 

operation execution means for causing said device to be operated to execute 
predetermined processing corresponding to user's operation conducted using said operation 
side terminal. 

3. (Original) The remote operation system as set forth in claim 1, further 
comprising 

screen information conversion means for converting data of an analysis result 
obtained by said screen analysis means into data suitable for the transmission to said 
operation side terminal or for displaying on a screen of said operation side terminal, wherein 

said screen information transmission means transmits data of a result of conversion by 
said screen information conversion means to said operation side terminal to display the data 
on said operation side terminal. 
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4. (Original) The remote operation system as set forth in claim 3, further 
comprising 

conversion rule registration means for registering and recording rules for converting 
data of an analysis result obtained by said screen analysis means into data suitable for the 
transmission to said operation side terminal or for displaying on the screen of said operation 
side terminal, wherein 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means based on the conversion rules recorded in said conversion rule 
registration means. 

5. (Previously Presented) The remote operation system as set forth in 
claim 4, further comprising 

device characteristic detection means for detecting device characteristics of said 
operation side terminal, wherein 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means based on device characteristics detected by said device 
characteristic detection means and conversion rules recorded in said conversion rule 
registration means. 

6. (Previously Presented) The remote operation system as set forth in 
claim 1 , further comprising 

screen change detection means, provided on said device to be operated, for detecting a 
change in display of the screen of said device to be operated, wherein 

at a time when a change occurred in display of the screen is completed, said screen 
analysis means analyzes the current screen of said device to be operated, and 

wherein said screen change detection means determines that the change that occurred 
in the display of the screen is completed when no screen change is detected in the display of 
the screen for more than a predetermined time period. 

7. (Previously Presented) The remote operation system as set forth in 
claim 1, wherein 

said device to be operated is an information processing device having a GUI, and 
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said screen analysis means detects GUI widgets displayed on an active window 
provided on the screen of said device to be operated to obtain attribute data of said GUI 
widgets. 

8. (Previously Presented) The remote operation system as set forth in 
claim 7, wherein 

the attribute data of said GUI widgets includes each of a kind of said GUI widgets, a 
name of said GUI widgets and a location of said GUI widgets in the screen. 

9. (Previously Presented) The remote operation system as set forth in 
claim 4, wherein 

said conversion rule registration means has registration of rules for converting data of 
an analysis result obtained by said screen analysis means into a web page that can be 
displayed by a web browser, 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means into a web page based on said rules, 

said web page includes, for GUI widgets operable by a user among GUI widgets 
detected by said screen analysis means, a hyper-link corresponding to the GUI widgets in 
question, and 

when said hyper-link is selected, data for identifying GUI widgets corresponding to 
the hyper-link in question and data for identifying operation for the GUI widgets in question 
are transmitted to said operation execution means. 

10. (Previously Presented) The remote operation system as set forth in 
claim 4, wherein 

said conversion rule registration means has registration of rules for converting data of 
an analysis result obtained by said screen analysis means into a text of electronic mail. 

1 1 . (Previously Presented) The remote operation system as set forth in 
claim 2, wherein 

said operation execution means receives electronic mail including information of 
user's operation conducted using said operation side terminal, analyzes the received 
electronic mail to identify the user's operation, and executes the operation in question. 
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12. (Original) The remote operation system as set forth in claim 1 , wherein 
data of an analysis result obtained by said screen analysis means is data of an XML 

format. 

13. (Original) The remote operation system as set forth in claim 1 , wherein 
said operation side terminal is a portable communication terminal having a character 

data transmission and reception function. 

14. (Original) The remote operation system as set forth in claim 1 , wherein 
said communication network is the Internet. 

15. (Previously Presented) The remote operation system as set forth in 
claim 1 , wherein 

said screen analysis means, when moving picture or still picture is displayed on the 
screen of said device to be operated along with non-picture information, detects the display in 
question to extract picture data of the display in question, and 

said screen information transmission means transmits said picture data extracted by 
said screen analysis means to said operation side terminal to display the data on said 
operation side terminal, 

wherein said screen analysis means does not perform any picture data extraction and 
ignores the non-picture information when moving picture or still picture is not displayed on 
the screen of said device to be operated. 

16. (Previously Presented) The remote operation system as set forth in 
claim 3, wherein 

said screen analysis means, when moving picture or still picture is displayed on the 
screen of said device to be operated along with non-picture information, detects the display in 
question to extract picture data of the display in question, and 

said screen information conversion means converts said picture data extracted by said 
screen analysis means into data suitable for the transmission to said operation side terminal or 
for displaying on the screen of said operation side terminal, 
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wherein said screen analysis means does not perform any picture data extraction and 
ignores the non-picture information when moving picture or still picture is not displayed on 
the screen of said device to be operated. 

17. (Original) The remote operation system as set forth in claim 5 3 wherein 
device characteristics of said operation side terminal detected by said device 

characteristic detection means include at least one of an inherent ID of said operation side 
terminal, a kind of machine, a processing rate, a communication rate, communication costs 
per unit volume of data, communication costs per unit time, a data format that can be 
displayed on a screen, a playable sound data format, executable program and script formats, a 
volume of data receivable at one time, a color that can be displayed, a character font that can 
be displayed, a screen resolution, a physical length of a screen in a vertical direction and a 
lateral direction and the number of characters that can be displayed within one screen in the 
vertical direction and the lateral direction. 

18. (Previously Presented) A remote operation system for remotely 
operating a device to be operated through a communication network from an operation side 
terminal, wherein 

said device to be operated comprises: 

screen analysis means for analyzing the contents displayed on a screen of said device 
to be operated, and 

screen information transmission means for transmitting data of an analysis result 
obtained by said screen analysis means to said operation side terminal to display the data on 
said operation side terminal, 

wherein said screen analysis means determines whether or not an active window is 
present on the screen of said device to be operated, and if so, said screen analysis means 
obtains property information of objects displayed on said active window, and 

wherein said screen information transmission means transmits only the data of the 
active window and the objects displayed therein, to said operation side terminal, and does not 
transmit any information on the screen of said device to be operated that does not correspond 
to the active window. 
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19. (Original) The remote operation system as set forth in claim 18, further 
comprising 

operation execution means for causing said device to be operated to execute 
predetermined processing corresponding to user's operation conducted using said operation 
side terminal. 

20. (Original) The remote operation system as set forth in claim 18, further 
comprising 

screen information conversion means for converting data of an analysis result 
obtained by said screen analysis means into data suitable for the transmission to said 
operation side terminal or for displaying on a screen of said operation side terminal, wherein 

said screen information transmission means transmits data of a result of conversion by 
said screen information conversion means to said operation side terminal to display the data 
on said operation side terminal. 

21. (Original) The remote operation system as set forth in claim 20, further 
comprising 

conversion rule registration means for registering and recording rules for converting 
data of an analysis result obtained by said screen analysis means into data suitable for the 
transmission to said operation side terminal or for displaying on the screen of said operation 
side terminal, wherein 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means based on the conversion rules recorded in said conversion rule 
registration means. 

22. (Previously Presented) The remote operation system as set forth in 
claim 21 , further comprising 

device characteristic detection means for detecting device characteristics of said 
operation side terminal, wherein 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means based on device characteristics detected by said device 
characteristic detection means and conversion rules recorded in said conversion rule 
registration means. 
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23. (Previously Presented) The remote operation system as set forth in 
claim 18, further comprising 

screen change detection means, provided on said device to be operated^ for detecting 
a change in display of the screen of said device to be operated, wherein 

at a time when a change occurred in display of the screen is completed, said screen 
analysis means analyzes the current screen of said device to be operated, and 

wherein said screen change detection means determines that the change that occurred 
in the display of the screen is completed when no screen change is detected in the display of 
the screen for more than a predetermined time period. 

24. (Previously Presented) The remote operation system as set forth in 
claim 18, wherein 

said device to be operated is an information processing device having a GUI, and 
said screen analysis means detects GUI widgets displayed on an active window 

provided on the screen of said device to be operated to obtain attribute data of said GUI 

widgets. 

25. (Previously Presented) The remote operation system as set forth in 
claim 24, wherein 

the attribute data of said GUI widgets includes each of a kind of said GUI widgets, a 
name of said GUI widgets and a location of said GUI widgets in the screen. 

26. (Previously Presented) The remote operation system as set forth in 
claim 21, wherein 

said conversion rule registration means has registration of rules for converting data of 
an analysis result obtained by said screen analysis means into a web page that can be 
displayed by a web browser, 

said screen information conversion means converts data of an analysis result obtained 
by said screen analysis means into a web page based on said rules, 

said web page includes, for GUI widgets operable by a user among GUI widgets 
detected by said screen analysis means, a hyper-link corresponding to the GUI widgets in 
question, and 
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when said hyper-link is selected, data for identifying GUI widgets corresponding to 
the hyper-link in question and data for identifying operation for the GUI widgets in question 
are transmitted to said operation execution means. 

27. (Previously Presented) The remote operation system as set forth in 

claim 21, wherein 

said conversion rule registration means has registration of rules for converting data of 
an analysis result obtained by said screen analysis means into a text of electronic mail. 

28. (Previously Presented) The remote operation system as set forth in 

claim 1 9, wherein 

said operation execution means receives electronic mail including information of 
user's operation conducted using said operation side terminal, analyzes the received 
electronic mail to identify the user's operation, and executes the operation in question. 

29. (Original) The remote operation system as set forth in claim 1 8, wherein 
data of an analysis result obtained by said screen analysis means is data of an XML 

format. 

30. (Original) The remote operation system as set forth in claim 1 8, wherein 
said operation side terminal is a portable communication terminal having a character 

data transmission and reception function. 

3 1 . (Original) The remote operation system as set forth in claim 1 8, wherein 
said communication network is the Internet. 

32. (Previously Presented) The remote operation system as set forth in 
claim 18, wherein 

said screen analysis means, when moving picture or still picture is displayed on the 
screen of said device to be operated, detects the display in question to extract picture data of 
the display in question, and 
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said screen information transmission means transmits said picture data extracted by 
said screen analysis means to said operation side terminal to display the data on said 
operation side terminal^ 

wherein said screen analysis means does not perform any picture data extraction when 
moving picture or still picture is not displayed on the screen of said device to be operated. 

33. (Previously Presented) The remote operation system as set forth in 
claim 20, wherein 

said screen analysis means, when moving picture or still picture is displayed on the 
screen of said device to be operated, detects the display in question to extract picture data of 
the display in question, and 

said screen information conversion means converts said picture data extracted by said 
screen analysis means into data suitable for the transmission to said operation side terminal or 
for displaying on the screen of said operation side terminal, 

wherein said screen analysis means does not perform any picture data extraction when 
moving picture or still picture is not displayed on the screen of said device to be operated. 

34. (Original) The remote operation system as set forth in claim 22, wherein 
device characteristics of said operation side terminal detected by said device 

characteristic detection means include at least one of an inherent ID of said operation side 
terminal, a kind of machine, a processing rate, a communication rate, communication costs 
per unit volume of data, communication costs per unit time, a data format that can be 
displayed on a screen, a playable sound data format, executable program and script formats, a 
volume of data receivable at one time, a color that can be displayed, a character font that can 
be displayed, a screen resolution, a physical length of a screen in a vertical direction and a 
lateral direction and the number of characters that can be displayed within one screen in the 
vertical direction and the lateral direction. 

35. (Previously Presented) A remote operation method of remotely 
operating a device to be operated through a communication network from an operation side 
terminal, comprising the steps of: 

a screen analysis step of analyzing, by a first unit provided on said device to be 
operated, information displayed on a screen of said device to be operated, and 
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screen information transmission step of transmitting, by a second unit provided on 
said device to be operated, data of an analysis result obtained by said screen analysis step to 
said operation side terminal to display the data on said operation side terminal, 

wherein said screen analysis step comprises determining whether or not an active 
window is present on the screen of said device to be operated, and if so, said screen analysis 
step obtains property information of objects displayed on said active window, and 

wherein said screen information transmission step comprises transmitting only the 
data of the active window and the objects displayed therein, to said operation side terminal, 
and does not transmit any information on the screen of said device to be operated that does 
not correspond to the active window. 

36. (Original) The remote operation method as set forth in claim 35, further 
comprising 

an operation execution step of causing said device to be operated to execute 
predetermined processing corresponding to user's operation conducted using said operation 
side terminal. 

37. (Original) The remote operation method as set forth in claim 35, further 
comprising 

a screen information conversion step of converting data of an analysis result obtained 
by said screen analysis step into data suitable for the transmission to said operation side 
terminal or for displaying on a screen of said operation side terminal, wherein 

at said screen information transmission step, data of a result of conversion by said 
screen information conversion step is transmitted to said operation side terminal to display 
the data on said operation side terminal. 

38. (Original) The remote operation method as set forth in claim 37, further 
comprising 

a conversion rule registration step of registering rules for converting data of an 
analysis result obtained by said screen analysis step into data suitable for the transmission to 
said operation side terminal or for displaying on the screen of said operation side terminal, 
wherein 
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at said screen information conversion step, data of an analysis result obtained by said 
screen analysis step is converted based on the conversion rules registered at said conversion 
rule registration step. 

39. (Previously Presented) The remote operation method as set forth in 
claim 38, further comprising 

a device characteristic detection step of detecting device characteristics of said 
operation side terminal, wherein 

at said screen information conversion step, data of an analysis result obtained by said 
screen analysis step is converted based on device characteristics detected by said device 
characteristic detection step and conversion rules registered at said conversion rule 
registration step. 

40. (Previously Presented) The remote operation method as set forth in 
claim 35, further comprising 

a screen change detection step of detecting, by said device to be operated a a change in 
display of the screen of said device to be operated, wherein 

at a time when a change occurred in display of the screen is completed, the contents 
displayed on the current screen of said device to be operated are analyzed by said screen 
analysis step, and 

wherein said screen change detection step determines that the change that occurred in 
the display of the screen is completed when no screen change is detected in the display of the 
screen for more than a predetermined time period. 

41. (Previously Presented) The remote operation method as set forth in 
claim 35, wherein 

said device to be operated is an information processing device having a GUI, and 

at said screen analysis step, GUI widgets displayed on an active window provided on 

the screen of said device to be operated is detected to obtain attribute data of said GUI 

widgets. 

42. (Previously Presented) The remote operation method as set forth in 
claim 41, wherein 
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the attribute data of said GUI widgets includes at l e ast one each of a kind of said GUI 
widgets, a name of said GUI widgets and a location of said GUI widgets in the screen. 

43. (Previously Presented) The remote operation method as set forth in 
claim 38, wherein 

at said conversion rule registration step, rules are registered for converting data of an 
analysis result obtained by said screen analysis step into a web page that can be displayed by a 
web browser, 

at said screen information conversion step, data of an analysis result obtained by said 
screen analysis step is converted into a web page based on said rules, 

said web page includes, for GUI widgets operable by a user among GUI widgets 
detected by said screen analysis step, a hyper-link corresponding to the GUI widgets in 
question, and 

at said operation execution step, using data for identifying GUI widgets corresponding 
to the hyper-link in question and data for identifying operation for the GUI widgets in 
question which are transmitted when said hyper-link is selected, the operation side terminal is 
caused to execute predetermined processing. 

44. (Previously Presented) The remote operation method as set forth in 
claim 38, wherein 

at said conversion rule registration step, rules are registered for converting data of an 
analysis result obtained by said screen analysis step into a text of electronic mail. 

45. (Previously Presented) The remote operation method as set forth in 
claim 35, wherein 

at said screen analysis step, when moving picture or still picture is displayed on the 
screen of said device to be operated, the display in question is detected to extract picture data 
of the display in question, and 

at said screen information transmission step, said picture data extracted by said screen 
analysis step is transmitted to said operation side terminal to display the data on said 
operation side terminal, 

wherein said screen analysis step does not perform any picture data extraction when 
moving picture or still picture is not displayed on the screen of said device to be operated. 
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46. (Previously Presented) The remote operation method as set forth in 
claim 37, wherein 

at said screen analysis step, when moving picture or still picture is displayed on the 
screen of said device to be operated, the display in question is detected to extract picture data 
of the display in question, and 

at said screen information conversion step, said picture data extracted by said screen 
analysis step is converted into data suitable for the transmission to said operation side 
terminal or for displaying on the screen of said operation side terminal^ 

wherein said screen analysis step does not perform any picture data extraction when 
moving picture or still picture is not displayed on the screen of said device to be operated. 

47. (Original) The remote operation method as set forth in claim 39, wherein 
device characteristics of said operation side terminal detected by said device 

characteristic detection step include at least one of an inherent ID of said operation side 
terminal, a kind of machine, a processing rate, a communication rate, communication costs 
per unit volume of data, communication costs per unit time, a data format that can be 
displayed on a screen, a playable sound data format, executable program and script formats, a 
volume of data receivable at one time, a color that can be displayed, a character font that can 
be displayed, a screen resolution, a physical length of a screen in a vertical direction and a 
lateral direction and the number of characters that can be displayed within one screen in the 
vertical direction and the lateral direction. 

48. (Previously Presented) A remote operation program for remotely 
operating a device to be operated through a communication network from an operation side 
terminal by controlling an information processing system, which causes execution of: 

screen analysis processing, provided on said device to be operated, of analyzing 
information displayed on a screen of said device to be operated, and 

screen information transmission processing, provided on said device to be operated, of 
transmitting data of an analysis result obtained by said screen analysis processing to said 
operation side terminal to display the data on said operation side terminal, 

wherein said screen analysis processing comprises determining whether or not an 
active window is present on the screen of said device to be operated, and if so, said screen 
analysis step obtains property information of objects displayed on said active window, and 
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wherein said screen information transmission processing comprises transmitting only 
the data of the active window and the objects displayed therein, to said operation side 
terminal, and does not transmit any information on the screen of said device to be operated 
that does not correspond to the active window. 

49. (Original) The remote operation program as set forth in claim 48, which 
causes execution of operation execution processing of making said device to be operated 
conduct predetermined processing corresponding to user's operation conducted using said 
operation side terminal. 

50. (Original) The remote operation program as set forth in claim 48, which 
causes screen information conversion processing of converting data of an analysis result 
obtained by said screen analysis processing into data suitable for the transmission to said 
operation side terminal or for displaying on a screen of said operation side terminal, and 

in said screen information transmission processing, causes execution of processing of 
transmitting data of a conversion result obtained by said screen information conversion 
processing to said operation side terminal to display the data on said operation side terminal. 

51. (Original) The remote operation program as set forth in claim 50, which 
causes execution of conversion rule registration processing of registering rules for converting 
data of an analysis result obtained by said screen analysis processing into data suitable for the 
transmission to said operation side terminal or for displaying on the screen of said operation 
side terminal, and 

in said screen information conversion processing, causes execution of processing of 
converting data of an analysis result obtained by said screen analysis processing based on the 
conversion rules registered by said conversion rule registration processing. 

52. (Previously Presented) The remote operation program as set forth in 
claim 51, which causes execution of device characteristic detection processing of detecting 
device characteristics of said operation side terminal, and 

in said screen information conversion processing, causes execution of processing of 
converting data of an analysis result obtained by said screen analysis processing based on 
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device characteristics detected by said device characteristic detection processing and 
conversion rules registered by said conversion rule registration processing. 

53. (Previously Presented) The remote operation program as set forth in 
claim 48, which causes execution of; 

screen change detection processing of detecting, provided on said device to be 
operated, a change in display of the screen of said device to be operated, and 

at a time when a change occurred in display of the screen is completed, processing of 
analyzing the contents displayed on the current screen of said device to be operated by said 
screen analysis processing, and 

wherein said screen change detection processing determines that the change that 
occurred in the display of the screen is completed when no screen change is detected in the 
display of the screen for more than a predetermined time period. 

54. (Previously Presented) The remote operation program as set forth in 
claim 48, wherein 

said device to be operated is an information processing device having a GUI, and 

in said screen analysis processing, the program causes execution of processing of 

detecting GUI widgets displayed on an active window provided on the screen of said device 

to be operated to obtain attribute data of said GUI widgets. 

55. (Previously Presented) The remote operation program as set forth in 
claim 54, wherein 

the attribute data of said GUI widgets includes each of a kind of said GUI widgets, a 
name of said GUI widgets and a location of said GUI widgets in the screen. 

56. (Previously Presented) The remote operation program as set forth in 
claim 51, wherein 

in said conversion rule registration processing, rules are registered for converting data 
of an analysis result obtained by said screen analysis processing into a web page that can be 
displayed by a web browser, 

in said screen information conversion processing, data of an analysis result obtained 
by said screen analysis processing is converted into a web page based on said rules, 
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said web page includes, for GUI widgets operable by a user among GUI widgets 
detected by said screen analysis processing, a hyper-link corresponding to the GUI widgets in 
question, and 

in said operation execution processing, in order to cause the operation side terminal to 
execute said predetermined processing, data for identifying GUI widgets corresponding to the 
hyper-link in question and data for identifying operation for the GUI widgets in question 
transmitted when said hyper-link is selected. 

57. (Previously Presented) The remote operation program as set forth in 
claim 5 1 , which 

in said conversion rule registration processing, causes execution of processing of 
registering rules for converting data of an analysis result obtained by said screen analysis 
processing into a text of electronic mail. 

58. (Previously Presented) The remote operation program as set forth in 
claim 48, which causes execution of: 

in said screen analysis processing, when moving picture or still picture is displayed on 
the screen of said device to be operated, detecting the display in question to extract picture 
data of the display in question, and 

in said screen information transmission processing, processing of transmitting said 
picture data extracted by said screen analysis processing to said operation side terminal to 
display the data on said operation side terminal, 

wherein said screen analysis processing does not perform any picture data extraction 
when moving picture or still picture is not displayed on the screen of said device to be 
operated. 

59. (Previously Presented) The remote operation program as set forth in 
claim 50, which 

in said screen analysis processing, when moving picture or still picture is displayed on 
the screen of said device to be operated, detects the display in question to extract picture data 
of the display in question, and 
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in said screen information conversion processing, converts said picture data extracted 
by said screen analysis processing into data suitable for the transmission to said operation side 
terminal or for displaying on the screen of said operation side terminal, 

wherein said screen analysis processing does not perform any picture data extraction 
when moving picture or still picture is not displayed on the screen of said device to be 
operated. 

60. (Original) The remote operation program as set forth in claim 52, wherein 
device characteristics of said operation side terminal detected by said device 
characteristic detection processing include at least one of an inherent ID of said operation side 
terminal, a kind of machine, a processing rate, a communication rate, communication costs 
per unit volume of data, communication costs per unit time, a data format that can be 
displayed on a screen, a playable sound data format, executable program and script formats, a 
volume of data receivable at one time, a color that can be displayed, a character font that can 
be displayed, a screen resolution, a physical length of a screen in a vertical direction and a 
lateral direction and the number of characters that can be displayed within one screen in the 
vertical direction and the lateral direction. 
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